Unsupervised Learning of Shape-Motion Patterns for Objects in Urban Street Scenes
نویسندگان
چکیده
Tracking in urban street scenes is predominantly based on pretrained object-specific detectors and Kalman filter based tracking. More recently, methods have been proposed that track objects by modelling their shape, as well as ones that predict the motion of objects using learned trajectory models. In this paper, we combine these ideas and propose shape-motion patterns (SMPs) that incorporate shape as well as motion to model a variety of objects in an unsupervised way. By using shape, our method can learn trajectory models that distinguish object categories with distinct behaviour. We develop methods to classify objects into SMPs and to predict future motion. In experiments, we analyze our learned categorization and demonstrate superior performance of our motion predictions compared to a Kalman filter and a learned pure trajectory model. We also demonstrate how SMPs can indicate potentially harmful situations in traffic scenarios.
منابع مشابه
Multi-object Motion Pattern Classification for Visual Surveillance and Sports Video Retrieval
This paper presents a method to classify scenes based on motion information. While they use object trajectories or optical flow field as motion information in previous work, we use the instantaneous motions of multiple objects in each image. In order to deal with variable number of objects in a scene, we use moment statistics as features. Our approach is based on clustering, a form of unsupervi...
متن کاملJoint Object Pose Estimation and Shape Reconstruction in Urban Street Scenes Using 3D Shape Priors
Estimating the pose and 3D shape of a large variety of instances within an object class from stereo images is a challenging problem, especially in realistic conditions such as urban street scenes. We propose a novel approach for using compact shape manifolds of the shape within an object class for object segmentation, pose and shape estimation. Our method first detects objects and estimates the...
متن کاملTraffic Scene Analysis using Hierarchical Sparse Topical Coding
Analyzing motion patterns in traffic videos can be exploited directly to generate high-level descriptions of the video contents. Such descriptions may further be employed in different traffic applications such as traffic phase detection and abnormal event detection. One of the most recent and successful unsupervised methods for complex traffic scene analysis is based on topic models. In this pa...
متن کاملUnsupervised learning of object detectors for everyday scenes
This paper proposes an unsupervised learning framework in which models of objects’ appearance classes are learned using their spatio and temporal information, from video. These models are used to detect objects of different classes in the everyday scene. The proposed technique combines appearance and motion features in a weighted combination framework resulting in models of object classes. Thus...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016